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PROBLEM 

Usually  an  experiment  Is  conducted  to  shot*  how  the  experimental 
treatments  affect  mean  changes  of  some  (dependent)  variable.  Sometimes  there 
Is  Interest  In  how  the  treatments  affect  the  spread  of  the  dependent  variable 
observations. 


FINDINGS 

A  method  Is  presented  for  showing  how  the  variability  of  the  dependent 
variable  Is  affected  by  treatments.  The  treatments  may  be  defined  In  terms  of 
several  variables,  effects  of  which  can  be  Isolated  and  evaluated.  A  FORTRAN 
language  computer  program  Is  appended  which  Implements  the  method. 


RECOMMENDATION 

Use  the  method  described  herein  to  show  how  multi  factor  treatments  affect 
the  variances  of  observations. 
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Introduction 

How  Mas  the  variability  of  observations  affected  by  experimental 
treatments?  This  question  Is  often  of  Interest  during  the  analysis  of  an 
experiment.  There  are  two  typical  reasons  for  such  Interest.  First, 
Intertreatment  homogenlety  of  variances  Is  an  assumption  required  for 
analysis  of  effects  of  the  treatments  on  the  means  of  the  observations  (Winer, 
1971).  Therefore,  a  careful  analyst  assesses  the  credibility  of  the 
hypothesis  of  homogenlety  of  variance  even  though  his  primary  Interest  Is  In 
changes  of  the  means.  In  addition,  sometimes  the  effect  of  the  treatments  on 
the  variances  of  observations  Is  the  analysts'  main  Interest  (Bitter  ft  Carter, 
1982).  nils  would  be  the  case,  for  Instance,  If  the  treatment  were  repeated 
experience  with  some  task  (e.g.,  a  mental  test)  and  one  wished  to  Investigate 
the  theory  (Jensen,  1980)  that  the  variance  of  observations  Increases  with  the 
amount  of  experience  the  subjects  have  had  with  the  task. 

Many  methods  are  available  for  Investigating  the  hypothesis  of 
homogenlety  of  variances  In  experiments  having  only  one  Independent  variable 
(l.e.,  treatment)  which  Is  used  at  only  a  few  levels  of  Its  range.  These 
methods  are  summarized  by  Winer  (1971)  and  Hollander  and  Wolfe  (1975).  Such 
methods  are  not  directly  applicable  to  experiments  having  multiple  Independent 
variables.  In  addition,  they  are  not  applicable  for  assessing  trends  In  the 
variances  associated  with  an  Independent  variable  whose  range  Is  sampled  at 
many  levels  (e.g.,  Jensen's  theory  mentioned  above  Implies  an  Increasing  trend 
In  the  variances  as  the  Independent  variable  of  practice  Increases). 

Games  (1978)  has  suggested  an  approach  to  analysis  of  the  variability  of 
observations  In  multifactor  experiments.  In  essence,  he  proposed  that  the 
natural  log  transformed  (In)  variances  be  considered  as  observations  In  an 
experimental  design  having  one  observation  per  treatment  condition.  This 
Ingenious  Idea,  built  upon  earlier  suggestions  of  Scheffe  (1959),  Is  adequate 
for  many  purposes.  Its  primary  drawback  Is  that  It  uses  the  Interaction  mean 
square  to  estimate  Its  error  variance.  This  use  precludes  Investigations  of 
the  Interaction.  In  addition,  the  strength  of  a  test  depends  heavily  on  the 
number  of  degrees  of  freedom  In  the  estimate  of  the  statistical  error  (l.e.. 
Interaction  mean  square).  If  the  experiment  had  2.  observations  at  each  of  J^ 
levels  of  one  treatment  by  K  levels  of  another  treatment.  Games'  technique 
provides  an  error  estimate  with  degrees  of  freedom  equal  to  the  product: 
(K-1)(J-1).  Hence  the  error  estimate  can  be  quite  puisne  If  either  J^  or  JK  Is 
small.  Increasing  the  number  of  observations,  I,  does  not  help  directly- 
because  they  are  all  collapsed  Into  one  observaTlon  (variance)  per  treatment 
condition.  It  appears  that  a  better  technique  would  somehow  take  greater 
advantage  of  the  I  observations  per  treatment  condition.  Then  the  statistical 
test  of  the  variances  would  have  adequate  degrees  of  freedom  If  the  number  of 
observations  were  reasonable. 

The  statistical  jackknife  (Mosteller  ft  Tukey,  1977)  enables  the  analyst 
to  use  the  degrees  of  freedom  associated  with  the  observations.  It  has  been 
used  to  test  homogenlety  of  variances  (Hollander  ft  Wolfe,  1973)  In 
single-treatment  experiments.  Games,  Keselman,  and  Clinch  (1979)  endorse  Its 
use  In  multifactor  experiments. 
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The  Jackknl f e 

The  statistical  jackknife  Is,  as  the  name  Implies,  a  handy 
general-purpose  tool.  The  purpose  for  which  It  Is  used  here  Is  to 
approximate  the  distribution  of  variances  In  each  treatment -condition  of  an 
experiment.  According  to  Mosteller  and  Tukey  (1977),  the  jackknife  works  well 
for  this  purpose  as  long  as  the  data's  sample  distribution  does  not  have 
straggling  tails  or  abrupt  end  points.  Is  roughly  symmetrical,  and  has  a 
sufficient  number  of  observations. 

The  jackknife  produces  numbers  which  have  a  distribution  like  that  of  a 
combination  of  the  original  data  (e.g.,  the  variance  Is  such  a  combination). 

If  there  are  2  observations  available,  then  ±  variance  surrogate  numbers  can 
be  produced  by  the  jackknife.  These  numbers~~can  be  analyzed  to  test  the 
hypothesis  of  homogenlety  of  variance  by  using  the  same  procedure  used  to  test 
the  hypothesis  of  homogenlety  of  the  means  of  the  original  observations.  The 
advantage  of  the  unity  of  analysis  made  possible  by  the  jackknife  Is  difficult 
to  overemphasize.  Obviously,  analysis  of  an  experiment  Is  simpler  If  the  same 
procedure  can  be  used  (on  the  observations  and  the  jackknife  variances)  to 
test  for  effects  on  the  means  and  variances.  Complete  parallelism  of  the  two 
analyses  lends  clarity  of  thought.  In  addition  to  simplicity  of  analysis.  As 
an  Illustration  of  the  type  of  analysis  which  can  be  done,  the  BMDP  computer 
program  P2V  (Dixon,  1981)  can  be  used  to  test  multifactor  experiments  for  main 
effects,  trends,  and  Interactions  of  means  (and  jackknife  variances).  To  take 
advantage  of  this  program  for  Inferences  on  variances  only  jackknife  variance 
estimates  need  to  be  prepared.  A  computer  program  will  be  presented  which 
prepares  jackknife  variances  for  analysis. 

A  Computer  Program  to  Prepare  Jackknife  Variances 

The  FORTRAN  computer  program  of  APPENDIX  A  produces  the  jackknife 
variance  surrogate  numbers  referred  to  above.  A  jackknife  variance  (Hollande 
&  Wolfe,  1977)  is  produced  corresponding  to  each  observation  In  each  treatment 
condition  (which  may  be  defined  by  multiple  treatment  factors).  Corresponding 
to  observation  number  i_  In  treatment  m  Is 

Si *2  =  N*ln(s2all)  -  (N-l)*ln(s2i) 

where  S*2  is  a  jackknife  variance,  S2al 1  and  S21  are  the  usual  variance 
estimates  calculated,  respectively,  with  all  observations  In  treatment  m  or 
all  but  observation  _1  where  J1  Is  the  number  of  observations  (e.g.,  subjects) 

In  treatment  m.  The” natural  log-transformation  (In)  Is  employed  to  reduce  the 
effect  of  kurTosIs  on  the  dispersion  of  the  variance  estimates  (Scheffe, 

1959). 

In  APPENDIX  A,  ^all  taken  from  the  diagonal  of  a  variance-covariance 
matrix  of  all  the  observations  In  all  the  treatments,  and  is  a  diagonal 
element  of  the  variance-covariance  matrix  of  all  observations  except  the  1th 
In  each  treatment  condition.  The  variance-covariance  matrix  Is  generatecTby  a 
subroutine  named  CORAN  (UNIVAC,  1969).  The  jackknife  variances  are  then 
punched  on  computer  cards  In  the  same  format  as  the  original  data.  The 
jackknife  variances  may  then  be  analyzed  conveniently  using  the  same  method 
used  for  the  original  data. 
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In  addition,  the  program  In  APPENDIX  A  prints  the  original  data  and  S?al1 
for  each  treatment  condition,  and  punches  on  computer  cards  the  correlations 
among  the  observations  In  all  pairs  of  treatment  conditions.  The  original 
data  are  printed  for  Identification  and  verification  purposes.  The  variances, 
Jrall»  ^or  eac^  treatment  condition  are  printed  for  the  Information  of  the 
User.  Furthermore,  the  correlations  are  punched  for  convenience  of  analysts 
who  wish  to  explore  the  correlation  structure  of  repeated  measurements  using  a 
method  such  as  that  described  by  Steiger  (1980).  All  of  this  provides  the 
analyst  with  options  not  ordinarily  available  for  more  complete  description  of 
the  data. 
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THIR  IS  I  FORTRAN  l  INCH  A  OF  COMPUTFR  PRO  GR  A  M  TO  CA  LCUL AT  F  JACKKNIFE 
VARIANCF  ESTIMATES  ANO  OTHFR  USEFUL  ST  ATISTTCS*  THF  PROGRAM  USF  S 
COR  AN  »  A  UNIVAC  ST  AT  PACK  SURROUT  TNF  TO  CALCULATE  CORRflATIQNS  A  MO 
V  AR3  ANCFS.  ANOTHER  SUBROUTINE  COULO  OF  SUBSTITUTED  FOR  COR  AN. 
DIMENSION  OAT  A I  25  .1*1  .CORR  If*  *  IF  I  »  0  CORR  ft *  •  1  *1  •  no  AT  Af?*»15  )• 

•PCORf  1*.1*1.Yf  T7*1.SYHGII*1fXGARI15I.OQnATAf3»25).  115.*  » 

•  PCORf 15.1*1  .Vt  ,SYMO|J‘l  »X8AR  IIS)  *000 AT  A  #3*2*)  *15.5  I 

•PCORf  IB,  1*|,  Yf  Tf*).SYMRf1*tfXBARI15  )•  OOOAT  Af  3#  7*  .1  5-51 
NSU  B»Nn  AY  *  ARF  THF  NUMBER  OF  LFVEtS  OF  TWO  T  NOF  PF  NO  F  NT  V  ART  ARIFS  • 
NSURriS 
NOAVr TS 
NK=  1 
NT  sNSU* 

NT=NSUB 

NJrNnAV 

1SUR.T0AY.TDFN  ARF  THRFF  TNOFPFNOFN  T  VARIABLES. 

ontnnTsuRzt.NsuR 
OQll)nlnAY-T«  NO  AY 
00  ion  TOENrl.* 

READ  OATA 

EAD  f* .70011 nnOATACIOEN.TSUR.IOAV) 

00  FORMAT  f?4X.FT.?«?1XF7.?/?4XF7.?.21X.F7.?/24X.F7«7l 
00  CONTINUE 

00  BOO  TDFNri .» 

WRITE  OATA  FOR  TRENT TF TC AT  TON  AND  VERIFICATION. 

WRITE! F.R1 ) 

1  FORMATfTH  .♦DATA**) 

00  400  KSURrl.NSUB 

WRlTEff .?5»fnAT AfKSUR.TOAV).I0AV=1 .1  SI 
5  FORMATflH  .1SF7.9) 

DO  CONTINUE 

WRITE  CORRELATION  MATRIX  WITH  LFVFl*  OF  TO  AY  A  S  THF  INCFY  OF  THF 
MATRIX. 

C  Alt  COR ANf OATA.NSUR.Nn AY. 1 .O.XRAR. CORR .P COR .7 S. 15  I 
00  JOTlrl ,NP  AY 

WRITE  f 7.76)1  CORR!  T.J I .J  =  N0AY.T.-1 1 
F  FORMATfTH  .1*F*.3t 

07  CONTIMIIF 

C  At  TUL  AT  E  AND  WR  TT  F  V  AR  I  AN  CF  FOR  FACH  IFVFL  OF  TD  AY  WTTMTN  EACH 
LEVEL  OF  IOFN. 

C  ALL  COR  AN  C  OAT  A  .NSUB  .NO  AY  .O.O.XRAR  .CORR.PCOF  »?«  .1  5) 

WRITE  IE. 701  CURRIM.MI  ,M=1  .NOA V  1 
7  01  FORM  ATI  1H0.  *V*RT  ANCFS  !•  ./.1*F  7.2  > 

11=1 
L  2  =  1  S 

00tniTSUR=1«NStlR 

K=0 

00104 JSUB=1 .NSUB 

IF  I JSUR.EO.TSUB) ROT0104 

KSK41 

001B7TpAYr1.N0AY 

00  AT  A f M.IOAY I=0»T Af J SUB. TO AY  ) 

1C?  CONTINUF 
104  CONTIMIIF 
N=NSUB» 1 

C  All  COR  ANf  OOATA.N.NOAY. 0.0  .  XB  AR  .  OC0RR  .P  COR  .2*  .1  «l 

oninflri.NCAY 

l  =  f  T  SUB-1 |«N0AY4T 

r.  CAICULATF  JACKKNTFF  VARTANCF  FST  IM  AT  FS  • 

Vll  IrNSUB.AL  ORICORRf  T  •  T I  I  -  f  NSUB- 1  I  •  ALO Qf  OCORR  f  T •  Tl  I 
ILF  CONTTNUF 
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C  WRITE  JACKKNIFE  VARIANCE  ESTIMATES* 

WRITE!  1*211  I  TIT!  .1=11  .1?) 

?T  F0RNATI1H  .10E7.5./1H  • 

l?=L9«1K 
9Ct  CONTINUE 
PRO  CONTTNUF 
STOP 
ENO 


